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Abstract 



^ Let X be a stationary process with finite state-space A. Bressaud et al. 

recently provided a sufficient condition for the natural filtration of X to be 
standard when A has size 2. Their condition involves the conditional laws 
p{-\x) of Xq conditionally on the whole past {Xk)k^-i = x and controls 

CO the strength of the influence of the "old" past of the process on its present 

Xq. It involves the maximal gaps between p{-\x) and p{-\y) for infinite 
sequences x and y which coincide on their n last terms. In this paper, we 

^ first show that a slightly stronger result holds for any finite state-space. 

^ Then, we provide sufficient conditions for standardness based on average 

^ gaps instead of maximal gaps. 

> 

X 

^ 1 Introduction 

1.1 Setting 

In this paper we study stationary processes X — {Xn)n£Z indexed by the integer 
line Z and with values in a finite set A. We assume that X is defined recursively 
as follows: for every n e Z, Xn is a function of the "past" X^_i = {Xk)kiin-i of 
X and of a "fresh" random variable C/„, which brings in some "new" randomness. 
In particular the process U — {Un)n& is independent. To be more specific, we 
introduce some notations and definitions about cr-algebras. 

All (7— fields are assumed to be complete. For every process ^ = (CrOrtez and 
every n e Z, let = (Cfe)fc<n and = <^(Cn)- The natural filtration of ^ is the 
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nondecreasing sequence J-"^ = Furthermore, J-'^ = a{C,k ; k E Z) and 

J^loo is the tail cr-algebra J^i^o = dkez-^k- 

We say that a process f/ is a governing process for X, or that U governs X if, for 
every n G Z, (i) f/„+i is independent of J-'n'^ i and (ii) Xn+i is measurable with 
respect to a{Un+i) V J-"^. In particular any governing process is independent. 
If moreover the [/„ are uniform on [0,1], the process {U^X) is - according to 
Schachermayer's definition [S] and up to a time reversal - a parametrization of 
the process X. 

Likewise, we say that a process f/ is a generating process for X, or that U gen- 
erates X if, for every n G Z, X„ is measurable with respect to J-"^. This is 
equivalent to the condition that J-jf C J^^ every n G Z, a property which, 
from now on, we write as J-"^ C J-"^. 

One could be led to believe that when J^^^ is trivial, any process governing X 
generates X as well. But, although notoriously used by Wiener and Kallianpur 
in [5] (not pubhshed but see a discussion in [7]), this argument is false. As a 
simple counterexample, assume that X is i.i.d., that every Xn is uniform on 
{ — 1,1}, and set f/„ = for every n G Z. Then J^^^ is trivial and U 

governs X but Xq is independent of hence U does not generate X. 

Governing and generating processes are related to immersions of filtrations. Re- 
call that the filtration J^^ is immersed in the filtration J-"^ if J^^ C J^^ and if, 
for every n G Z, J^^+i and J-"^ are independent conditionally on J^^ . Roughly 
speaking, this means that J^^ gives no further information on Xn+i than J-"^ does. 
Equivalently, J^^ is immersed in J^^ if every J-'^-martingale is an J-'^-martingale. 



The following easy fact holds (see a proof in section 5.2). 



Lemma 1.1 If U is a governing and generating process for X, then is im- 
mersed in . 

Another notable property of filtrations is standardness . Recall that is stan- 
dard if, modulo an enlargement of the probability space, one can immerse 
in a filtration generated by an i.i.d. process. Vershik introduced standardness in 
the context of ergodic theory. Examples of non-standard filtrations include the 
filtrations of [T, T~^] transformations, introduced in Split-word processes, in- 
spired by Vershik's (r„)-adic sequences of decreasing partitions [lO] and studied 
in [9] and [6], for instance, also provide non-standard filtrations. 



Obviously, lemma IJ^ above implies that if X has a generating and governing 
process, then is standard. Whether the converse holds is not known. 

Necessary and sufficient conditions for standardness include Vershik's self-joining 
criterion and Tsirelson's notion of J-cosiness. Both notions are discussed in [?] 
and are based on conditions which are subtle and not easy to use nor to check in 
specific cases. 
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Our goal in this paper is to provide sufficient conditions of standardness that are 
easier to use than the ones mentioned above. Each of our conditions involves 
a measure of the influence of the "old" past of the process on its present. We 
introduce them in the next section. 

1.2 Statement of the results 

We now introduce some measures of the influence of the past of a process on its 
present. To conveniently state these definitions and, later on, our results, we first 
introduce some notations. 

Recall that X is a stationary process indexed by the integer line Z with values 
in some finite set A and with natural filtration J^^. 

Notation 1 (1) Slabs: For any sequence ({n)nez in A^, deterministic or random, 
and any integers i ^ j, is the {j — i + l)-uple (Cn)j^n^i in, A^'"''^^. 

(2) Shifts: Ifk — i — i — j, ^i:k — Cj-i nieans that = Q+n for every integer n 
such that ^ n ^ k — i. 

Infinite case: Let A^ denote the space of sequences {^n)n^-i- For every i in Z, 
a sequence {^n)niii is also considered as an element of A^ since, similarly to the 
finite case, one identifies = {^n)n^i and = {Cn)n^j if ii+n = Cj+n for every 
integer n ^ 0. 

(3) Concatenation: For all i ^ 0, j ^ 0, x = (x„)i<g„^i in A^ and y — {yn)i^n^j 
in A^ , xy denotes the concatenation of x and y, defined as 



Infinite case: i ^ 0, y = (y„)issn^i in A"^ and x = (a;„)„^_i in A"^, xy denotes the 
concatenation of x and y, defined as 



xy = {xi, ...,,Xi,yi,..., yj), xy e A'+^ . 



xy ^{.. . ,x_2,x_i,yi, . . .,yi), xy e A"^. 



Notation 2 For each n ^ 0, x G A" and a & A, set 



p{a\x) = P(Xo = a I = x). 



with the convention 



p{a\x) 



P(Xo 



a) if P[X_„:_i = x] = 0. 



In the following. 



p{-\x) 



P(Xo 



X 



x) 



X G A^, 



denotes a regular version of the conditional law of Xq given X^ 
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We now introduce three quantities 7^, ctn and 5n measuring the pointwise influ- 
ence at distance n. 

Definition 1 For every n ^ 0, let 

7„ = 1 - inf j ^^^l^^j ; a e A, x e A"^, y e A"^, z e A", p(a\yz) > 
{p{a\yz) 



a. 



5n = sup {\\p{-\xz)-p{-\yz)\\ ; x e A-^, e A^, z G A"}, 

where, for all probabilities fi and v on A, \\i — v\ is the distance in total variation 
between fi and v, defined as 

Note that the definitions of 7„, a„ and (5„ depend on the choice of the regular 
version {p[-\x))x&A< of the conditional law of Xq given X'^^. One needs a "good" 
version to get small infiuences for applying the theorems below. 

The sequences (7n)n>05 (an)n^o and (5n)n>o are non-increasing, [0, l]-valued, and 



^ In^ ^ O-n for cvcry u ^ (see the proof in section 5.1 ). 
For every [0, l]-valued sequence {en)n^o, we consider the condition 

+00 k 



k=0 n=0 

For instance, 'H{'~f) and 'H{26) are respectively 

+00 k +00 k 

i]n^^~^") = ^ -25„) = +00. 

A:=0 n=0 fc=0 n=0 

Observe that if two [0, l]-valued sequences {en)n^o and (Cn)n^o are such that 
^ Cn for every n ^ 0, then 'H(C) implies ^{(e). Hence condition Tii^e) asserts 
that {en)n^o is "small enough" in a way. 

The definition of (7n)n>o and the assumption ^^(7) are both stated in pLj. The 
main result of pLj is the following. 

Theorem 1 (X.Bressaud, A.Maass, S.Martinez and J.San Martin's fl\) 

Assume that the size of A is 2, then 'H{'y) implies that J-"^ is standard. 
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The scope of theorem [T] is restricted by the following three conditions. First, the 
size of A must be 2. Second, one must control the ratios of probabilities which 
define 7„. Third, 'H(7) implies that 70 < 1, therefore one can show that ^^(7) 
implies the existence of c > such that p{a\x) ^ c for every x in and a in A 
such that f[Xo = a] > (see the proof in section 5.4). 

Our first result allows to get rid of the first two restrictions. 



Theorem 2 (1) Assume that A is finite, that 26o < 1 and that 'H{25) holds. 
Then is standard. 

(2) If the size of A is 2, 7/(5) alone implies that J^^ is standard. 

Theorem [2] generalizes and improves on theorem [l] of [1] , since Sn ^ 7n for every 
n. Note that the straight adaptation of the proof of [T] to sizes of A at least 3 
leads to the more stringent condition 7/(27). 

Another measure of influence, based on the quantities a„ defined before, is intro- 
duced and used in [2] (actually the notation there is a„ = 1 — a„). The authors 
show that if 1-L{a) holds, there exists a perfect sampling algorithm for the process 
X, a result which implies that J^^ is standard. But since Sn ^ for every 
n ^ 0, the result of |2] does not imply theorem [T} 

Theorems [l] and [2] and the exact sampling algorithm of [2] all require an upper 
bound of some pointwise influence sequence. Our next result uses a less restrictive 
hypothesis based on some average influences rjn, defined below. 

Definition 2 For every n ^ 0, let rjn denote the average influence at distance n, 
defined as 

Vn = 5^E[|b(-|^)-p(-|XVl^)||] .F[X_n:-l = zl 

and call Ti'lrj) the condition 

+00 

k=0 



Note that r]^ is also 

= m[M.\Y_n:-l) -p(-|XVl>^-n:-l)||], 

where Y is an independent copy of X. 



Definition 3 (Priming condition) 

We say that the process X fulfills the priming condition if for every a in A, 
p{a\X'^]) > almost surely. 
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Theorem 3 Assume that A is finite and that X fulfills the priming condition. 
Then, H'^r]) implies that J^^ is standard. 

The sequence (?7n)n^o is [0, l]-valued. If rjn < I for every n ^ 0, then Ti'^rj) clearly 



implies 'H(r/). Yet, since rjn ^ 5n for every n ^ (see the proof in section 5.1), 
the condition T-L'^rj) cannot be compared to the conditions T-L{S) and 'H{25). 

Theorem |3] gives a remarkable result for chains with memory of variable length. 
These chains, studied notably in |3] and widely used for mathematical models, 
are stationary processes X taking values in a finite alphabet A, such that the 
distribution of Xq given the past X'^^ depends only on a past of length £, 

where £ is random and measurable with respect to J^^i- 

More precisely, for x G A^, let 

= inf{n ^ ; y (-7- p{-\yx -n-.-i) is constant on A"^} 
= inf{n ^ 0; Vy G A^, p{-\yx^n:-i) = p{-\x)}- 

Then X is a variable length Markov chain if i{X^j) is almost surely finite. The 
following result holds. 

Corollary 1.2 // X fulfills the priming condition and if i{X^-^) is integrable, 
then the natural filtration T-^ is standard. 



Once again we refer the reader to section 5^ for the proof. 

Here is a plan of the rest of the paper. In section [2| we prove theorem |2} In 
section |3j we prove theorem [3j In section |4| we compare theorems [2] and [3] through 
examples. Finally in section |5| we prove some facts stated without proof in the 



introduction, namely lemma 1.1, corollary 1.2, a consequence of the assumption 



7/(7) and some inequalities involving the quantities 7„, 5„ and r\n. 

2 Pointwise influence 

2.1 Construction of a governing sequence 

We construct a governing sequence with values in the standard simplex on j\^A 
vertices. 

Notation 3 Let H he the hyperplane in defined by 

H={X= {Xa)aeA G : = 1}. 
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Let S be the simplex in H defined by 



S := (M+)^n/7= <! X e 



aeA ) 



In other words, S = Coiw{Ea) is the convex enveloppe of the canonical basis 

EA = {Ea)aeA of . 

Let A denote the Lebesgue measure on H and /i = (l5'/A(S'))A the uniform dis- 
tribution on S. 

Notation 4 For any probability p on A, let 

G{p) = {p{a))^^A = ^(P) ^ ^- 

For a in A, denote by fa{-,p) the affine map from H to H which sends Ea on 
G{p) and lets invariant E^ for every h in A, h ^ a. Let 

Saip) = fa{S,p) = Conv({G(j9)} U E^ \ {Ea}). 

A short computation yields the interpretation of p{a) below. 

Lemma 2.1 For any a in A, det(/a(-,p)) = p(a). Therefore, for any measurable 
BcS, 

X[faiB,p)] = \[B]p{a). 
In particular X{Sa{p)) = \{S)p{a), hence fi{Sa{p)) = p{a). 

We now characterize Sa{p)- 

By convention, for every r > 0, we set r/0 = oo, and 0/0 = 0. 
Lemma 2.2 Let p be a probability on A, a in A, then 

Sa{p) = \ x = {Xa)aGA ^ S : = mill ^ \ = \ x E S : \/hh E A, ^ 6 G A^^ 

y p[a) beA p[b) J 1^ p[a) p[b) 

Corollary 2.3 S is the union of the simplices Sa{p), with a in A and that, if 
a ^ h, the simplices Sa{p) and Sb{p) meet only at their boundary. 



Proof : it's a straight corollary of the lemmas 2.1 and 2.2 
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Proof. Call the right-hand side. Since Sa(p) is a convex polyedron and 

contains the points G{p) and for every b a, Saip) C 

As regards the other inclusion, let x — {xa)aeA in ^a{p)- Then Xa/p{a) is finite, 
and 

From the definition of xi/p{b) ^ Xa/p{a) for every b ^ a, hence one has 

~ p{b)xa/p{a) ^ for every b ^ a. Furthermore, 

hence x is indeed a bary center of the points G{p) and Efjior b ^ a. This concludes 
the proof. □ 

One knows that the simplices {Sa{p))aeA cover 5" and intersect only on a set of 
measure zero. Hence, for almost every s in 5", there exists a unique a in A such 
that s e Sa{p)- Our next definition deals with the tie cases. 

Definition 4 Fix once and for all a total ordering of A. For every s in S and 
every probability p on A with full support, define 

g{s,p) = min{a e A : s e Saip)}. 
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Figure 1: f{-,p) and g{-,p) 

Lemma 2.4 Let U denote a random variable uniformly distributed on S. Then 
the distribution of g{U,p) is p. 

Indeed, up to negligible events, {g{U,p) = a} = {U G Sa{p)}, hence 

F[g{U,p) = a]=fiiSaip))=pia). 

The following lemma is our main tool to construct governing sequences. 

Lemma 2.5 Let X be a random variable with distribution p on A. Let W be a 
random variable with uniform distribution on S and independent of X . Introduce 

U = fxiW,p) = J2faiW,p)l{x=a}. 

aeA 

Then U is uniformly distributed on S and X = g{U,p) almost surely. 

Proof. Since U G fx{S,p) = Sx{p), X = g{U,p) almost surely. We now prove 
that U is uniformly distributed on S. 
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The sets Sa{p) for a in A cover S and their pairwise intersections are neghgible 
for A. Hence, for every Borel subset B of S, 

G fi] = 5^P[X = a ; UW,p) G fi] = 5^P[X = a] • P[l^ G U;p)-\B)] 



aeA 



leA 



^ , , X{fa{;p)-\B)nS) ^ \{BnSa) \{B) 



XiS) 



XiS) 



aeA ^ ' aeA 

where the second equahty stems from the independence of X and W and the 
fourth equahty stems from lemma 2.1 This concludes the proof. □ 



2.2 Upper bound of the error 

In this section we study the dependence of the random variable g{U,p) with 
respect to p. The following result will be used twice. 

Proposition 2.6 (Upper bound of the error) Let U be a random variable 
uniformly distributed on S. Let p and q be two probabilities on A. Then, 

ng{U,p)^giU,q)]^2\\p-q\\. 

In the special case = 2, 

n9{U,p)^g{U,q)] = \\p~q\\. 

Remark 1 The better result when ^A = 2 is the reason why theorem^ involves 
weaker hypotheses on (5„)„ in this case. 
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Figure 2: Computation of F[g{U,p) 7^ g{U,(l)]- The grey area shows the s G S* 
such that g{s,p) 7^ g{s,q). 



Proof of proposition 2^ . Assume without loss of generahty that U is constructed 
from i.i.d. random variables {ea)aeA exponentially distributed with parameter 1, 
as follows. For every a in A, 

Ua 



The event {g{U,p) 7^ g{U, q)} depends on {ea)a, as follows. By definition of g, up 
to negligible events, 

{g{U,p) = g{U,q)} = [j Ca, with Ca = {Ue S^ip) H Sa{q)}. 

Furthermore, since for every a & A, F[Ca] = if p{a) = or q{a) = 0, and since 
/i(Ca n Cb) = for a 7^ 6, one gets 

ngiU,p) = giU,q)] = J2^[Ca]l{p^a)>0, ,(a)>0}. 



For every a G A such that p{a) > and q{a) > 0, lemma 2.2 



gives 



Ca = \ —r-^ = niin — ^ : — ^ = min — ^ !■ = s £a ^ niin ( pfa)— ^ , q{a)^^-\ \ 
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hence 



Conditioning on Ea and using that the random variables (£b)6^a are i.i.d., expo- 
nentially distributed and independent of £„, one gets 



P 



hence 



Therefore 



P 



= P[P| {£(, ^ Xb/a^a} £a] = JJ CXp {-\b/a£a) , 

E(e.p(-(EV).,))^,^J^. 



n9iU,p) = 9{U, q)] = ^P [C„] l{^(„)>o, ,(.)>o} 



{ p{a)>0, q{a)>0} 



This last expression is not so easy to compute because each X^/a is defined as a 
maximum. However, 



L{p(a)>0} 



E 



p(a)l{p(a)>o} 



Subtracting the expression for F[g{U,p) = g{U, q)] to this, one gets 



Coming back to the definition of Xb/a and using simple algebraic manipulations, 
one gets for any a E A such that p{a) > and q{a) > 0, 



1 



1 



Eb^a {Xb/a-p{b)/p{a)) 



1 + Eb^„P(&)/p(«) 1 + Eb^a (1 + Eb^aPib)/p{a)) (l + Eb^a Afe/a) 



r{a) 



q{a) + r{a) ' 



where 



+ 



Furthermore, for any a E A such that p{a) > and q{a) = one gets 



l + Eb^aPWM«) 



p(a) = p{a) 



r(a) 



g(a) + r(a) ' 
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Summing on every a, one gets finally 

r(a) 



ng{U,p)^g{U,q)] = Y,p{a) 



a<^A 



q{a) + r{a) 



If y4 = {a, a'} and, for example, q{a) < p{a), then r(a) = p{a)—q{a) and r(a') = 0, 
hence 

^9{U,p) ^ 9{U,q)] = r(a) = p{a) - q{a) = \\p - q\\. 
In the general case, note that 

q{a) + r{a) ^ q{a) + {q{b)p{a) - p{b)q{a)) = p{a), 



hence 



n9{U,p) + g{U,q)\ ^ 5^r(a) = [p(a)g(6) - q{a)p(h)\_ 



5^ [ w) - pip)]+ + pip) w) - 9(a)]. 



a&A bj^a 



where the last inequality stems from the fact that {u + f )+ ^ + (f )+ for 
every u and v. Finally, the last double sum is at most 2||p — which ends the 
proof in the general case. □ 

Recall that if p and q are two fixed probabilities on A, then for every random 
variables Zp and Zq with laws p and q defined on the same probabihty space, 

nZp^Zq] ^\\p-q\\. 

Conversely, a standard construction in coupling theory provides random variables 
Zp and Zq with laws p and q such that F[Zp ^ Zq] = \\p — q\\. 



The interest of proposition is to provide a global coupling of a// probabilities on 
A. One can wonder whether the constant 2 in this proposition can be improved. 
Our next result (not used in the sequel) shows that the constant 2 is optimal for 
the coupling {g{U,p))p, and that it is not possible to do much better with any 
other global coupling. 

Proposition 2.7 (Optimality of the upper bound of the error) 

// ^A ^ 3, the constant 2 in the inequality F[g{U,p) ^ g{U,q)] ^ 2\\p — q\\ of 



proposition \2.6\ is optimal. 

Furthermore, if {Zp)p is a family of random variables indexed by probabilities on 
A, where each Zp follows the law p, then there exist two probabilities p ^ q such 
that 

Zp^Zq]-^2{l-l/i^A)\\p-q\\. 
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Proof. The first part of tlie proposition follows from the explicit example where 
{a, b, c} C A, p{a) = q{a) = 1 — e and p{b) = q{c) = e in the limit e — > 0. 

As regards the second part, let = i^A and for every a in A, let denote the 
random variable of {Zp)p with uniform distribution on A \ {a}. Choose oq G A, 
and consider the random set D of the elements a of A such that Z"" = For 
every a,b E A, 

By summing over a,b G A and by taking expectations, one gets 

a,b 

Of course G -D, and Z°'° ^ Z), since Z"' ^ a almost surely for every a. Thus 
1 ^ #D ^ AT _ 1. Hence, 

^P[Z" ^ Z''] ^ 2(iV- 1). 

There are at most A^(A^ — 1) nonzero terms in the sum above, hence there exist 
a^b such that 

P[Z" ^ Z^\ ^ 

Since \Va-Vh\ = 1/(A^-1), this yields PfZ*^ ^ Z^] ^ 2(1 - l/iV)||p„ -pj, which 
ends the proof. □ 



2.3 Proof of theorem [2] 

Let W = {Wn)n& be an i.i.d. sequence of random variables, uniformly distributed 
on 5", independent of the process X. Applying the construction of governing 



sequences in section 2.1, we introduce, for every n in Z, 



Un = fxAWn,Pn-l) with P„_i=p(-|X 



n— ly 



Let G Z. Thanks to the stationarity of the process X and to the independence 
of X and W , Pn is the conditional law of X„+i given F^'^ ■ Since Wn+i is 



independent of T^'^ and lemma 2.5 yields that 

1. t/„+i is independent of J^^''^, and therefore of J-'^'^ i 

2. is uniformly distributed on S", 

3. = g{Un+i,Pn) almost surely. 
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For every T in Z, we now define a process X"^ which is a function of {Un)n^T+i 
in such a way that approximates X when T — )■ — oo. 

Let Xj = ao for n ^ T with G A fixed, and assume that is defined up to 
time n ^ T. Define 

Xj^^, = g{Un+u P^) where Pj = 



Proposition 2.6 imphes that for n ^ T, 

P[X„+i ^ Xj+i I J-,^'^] = P[(?(t/„+i,P„) ^ <7(f/.+i,Pj) I •Fn^'-n ^ 2||P„ - Pjll, 

because P„ and Pj are measurable for J^.^'^ and f/„+i is independent of J^n'^ ■ 

For n in Z, let count the number of consecutive times before n such that X^ 
and X coincide, that is, 

= max{A; ^ : Xj_fc+i^„ = X„_fe+i:„}. 

On the event {L^ = £}, the sequences X^ and (X^)J^ coincide on their last £ 
terms. Hence, on the event {L^ = £}, 

||P„ - P„^|| ^ sup {ib(-lx^) -v{-\yz)\\ ; X e y G ^ G A^} = 5,. 
One gets 

The end of our proof follows the method in [1]: consider a Z+-valued Markov 
chain, Z = (Z„)„,^o starting from Zq = 0, with transition probabilities 

Pi^i+i = 1 - 26i, pifl = 26i, for every i ^ 0. 

For any n ^ T, it happens that dominates stochastically Zn_T, in the sense 
of the following lemma. 

Lemma 2.8 For every k^O andn^T, P[L^ ^ k] ^ "^[Z^-t ^ k]. 



Proof of lemma 2.8 The result is obvious for n = T since Zq = 0. Assume that 
the result holds for n ^ T. Then, 

F[Ll^,^k + l] = P[L^ ^ A;, X„+i = Xj+i] 

= E[l|^T^,|P[X„+i = Xj+i I T^'^]] 

Since is non-increasing and since 26i < 1 for every i, the sequence indexed 
by i of general term — 26i) is non-decreasing. By induction, one obtains 

= F[Zn-T > k, Z„_T+1 = Zn-T + 1] 

= F[Z^^T+i > k + 1], 
which ends the recurrence over n ^ T and the proof of the lemma. □ 
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Using this to estimate f[L'^ = 0], one gets 

p[xj ^ x„] = = 0] ^ nzn-T = 0]. 

Let /i be the measure defined on Z+ by 

k 

u{k) = l[{l-26n), 

n=0 

for every k ^ 0. the hypothesis of theorem |2] ensure that fi has infinite mass. 

If nn:^(-'- ~ = 0, then fx is invariant and the state is recurent. But the 
chain Z is irreducible since the hypothesis of theorem [2] forces the positivity of 
the probabihties (1 — 25„). Hence Z is null recurrent. 

If nn:^!! ~ 25„) > 0, then Z is transient since for every i, the probability of 
never returning to i from i is Hn:^!-'- ~ > 0. In both cases 

P[Xj y^Xn] ^0 when T -oo. 



In other words, converges in probability to X„ when T — )• — oo, in particular 
Xn is measurable for J-"^ , which proves that U generate X. Using lemma 



1.1 



one 



gets that the filtration J-"^ is immersed in J^^ , therefore J-'^ is standard. This 
ends the proof of theorem |2} 

3 Average influences 

This section is devoted to the proof of theorem [3| 
3.1 Priming lemma 



Recall that the governing sequence U with values in S and based on lemma |2.5 
is defined by 

Un = fx,XWn,Pn-i) whcre P„_i=p(-|^„^-i), 
where W = (Wn)n£i is a sequence of i.i.d. random variables uniform on S, 



independent of X. Recall also that, from lemma 2.5 X„ = g{Un, Pn-i) almost 
surely for every n ^ 0. 

Let i > 0. Let us show that with probability close to 1, for each x in A^, Xi-i = x 
as soon as Ui.i G where is a measurable subset of with //-measure 
independent of x. 

Recall that X satisfies the priming condition if for every a in A, p{a\X^i) > 
almost surely. 
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Lemma 3.1 (Priming lemma) Set I > 0. If X verifies the priming condition, 
then for every e g]0, 1[, there exist a real number > and a collection {Bx)xeA^ 
of Borel sets of such that for every x e 

^i®\B,\ = and P[Xi:^ = X I U^..i eB,]^l-e. 

Therefore ifY is a random variable valued in A^ independent of Un)n&) 
P[C/i:^ e By] = A and P[Xi:^ = Y \ Ui..e e Sy] ^ 1 - £. 

Proof. For every n G Z, let P„ = p{-\X^). Thanks to the stationarity of the 
process X, P„ is the conditional law of Xn+i given J^^ and the priming condition 
ensures that the support of P„ is A almost surely. 

Let e g]0, 1[ and i > 0. For any fixed x E A^ let us construct by induction Borel 
sets B^, Bf oi S with positive measure such that for every m e {!,...,£}, 

where Co = Q and for every m G {1, ...,^}, 

C'm — {^l:m — ^l:m '■> t^l:m & B^ X ... X P^}. 

Let m G {!,...,£}. Assume that Bf,..., -B^_i are constructed verifying the induc- 
tion hypothesis. Since P[C^_i] > 0, one gets, thanks to the priming condition, 

F[Pm-l{Xm)=^ I Cm-l] =0. 

Therefore one can choose a real number q g]0, 1] such that 

F[Pm-l{Xm)^q I Cm-l] < J- 

Set Um = (Um,!, ■■; Um,N)- Siuce Xm = g{Um, Pm-i) almost surely, one gets up 
to negligible events, 

■{-i'^m — -^m} — ^ ■{-i'^m — -^m ; -Pm— l('^'m) ^ q} 

= {giUm: Pm-l) = ] Pm-l{Xm) > ?} 

Um,Xm ■ Um,k jj I \ 



(k) 



q 



^ niin Um,k ; Pm-i{xm) > q \ ■ 



Set 



Bl = {{y,,...,yM)eS; ^ ^ min 
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Then > and 

{X„ = Xra] Ura & B^} D {Um G B^ ] > q} . 

Since 

the independence of Um and and the choice of q yield 

P[CJ ^ P[f/„ G 5^ ; P^-i(x^) > g ; Cn-i] 
= /i(5^)P[P„_i(x„) > q ■ Cm~l] 

Therefore F[Cm] > 0. 

By reducing the Borel set B^ at the last step of the induction, one can make the 
measure x ... x B^] independent of x G A'''. Denote by f3i this measure, 

then set Bx = Bf X ... X B^ . One gets 

By independence, 
hence 



k)i 

k=l ' k=l 



> 1 - 



which ends the proof. □ 
3.2 Approximation until a given time 

Choose e > and i ^ 1 such that X^n^^ ^7" ^ ^' ~ i^^ ^] interval of 

integers such that t — s + 1 = £. 

Then, let F be a random variable taking values in A^, independent of (X„, f/n)nez 
and distributed like Xj. 



Lemma 3.1 provides a real number Pi and Borel sets {Bx)x^a^^ such that 
F[Xj = Y \ Uj e By] ^ 1-e and P[f/j G By] = Pi. 
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Using Y and the governing sequence {Un)n^t+i, let us construct random variables 
{X'j^)n^s by taking Xj = Y and for every n > t 

X; = giU^, P;_,) where P^.^ = 

The random variable Y is useful in the proof of our following result. 

Lemma 3.2 For every n ^ s, the law of X'^.^ is the law of Xg-n- 

Proof. For every n ^ t + 1, y E A"'^'^ and all x G A, 

P[X; = X I =y] = p{x\y) = P[X„ = x \ X^-.n-i = y]. 

Since the law of Xj = y is the same as the law of Xj, the result follows by 
induction. □ 

Lemma 3.3 One has F[X' ^ X on [s, +oo[ | Uj € By] ^ 3e. 



Proof. Since X„ = g{Un, Pn-i) and X'^ = g{Un, Pn_i), proposition 2.6 yields for 

n > t, 

p[x; ^ X. I T^i^i V ^ 2||p;_i - p„_i||. 

Let 

W = P[X; ^ X„ ; = ; G Py] . 

Since 

= ; f/j G By} G V (7(r), 

one gets 

^2^ E[\\pi-\Xl,yz)-p{.\yz)\\ 1 

y,z 

= 2J2 E[\\p{.\Xt,yz)-p{-\yz)\\] fi^'''{By) P[X:_, = yz] 



y,z 



= 2/3, J2 m\p{-\Xt,x) - p{-\x)\\] F[X.,.,r,_, = x] 
where the last three equations stem from the independence of X^_^, Uj, Ut+i;n-i 



and Y, from lemma 3.2 and from the definition of rjn- Hence, 



P[X; ^ X„ ; X:^„_i = X,:„_i I Uj G Py] < 27]n-s, 
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therefore, 

P[X;^„ = Xs:n I Uj e By] ^ P[X;^„_i = Xs:n-1 \ Uj G By] - 2r/„_,. 

By induction, one gets 

n—s 

P[X:,„ = X,.,n I Uj e By] ^ F[X'j = Xj \ Uj e By] - 2 ^r^^. 
Since X'j = Y and F[Xj = Y \ Uj E By] ^ I - e, this yields 

oo 

P[X' = X on [s, +cx)[ I Uj e By] ^ 1 - £ - 2 r/„ ^ 1 - 3e, 
which ends the proof. □ 

3.3 Successive approximations and end of the proof of 
theorem [3] 

Our next step in the proof of theorem [3] is to approach the random variable Xq 
by measurable functions of the governing sequence. To this aim, we group the 
innovations by intervals of times. For every m > one chooses such that 

^ r]n^ l/m. 



For each m, lemma 3.1 (the priming lemma) applied to £ = and e = l/m 
provides a real number > and Borel sets {Bx)xi^Ai^rn of 3^"^ with measure 
(3l^ such that 

F[X,.,L^ = X I eB,]^l- l/m. 

Choose an integer Mm ^ 1/(3l^. Split Z*_ into Mi intervals of length Li, M2 
intervals of length L2, ... More precisely set, for every n ^ 1, 

in = Lm if Ml + ■ ■ ■ + M^_i < n ^ Ml + ■ ■ ■ + M„ 

and 

En = l/m if Ml H h Mm-i <n^ Mi-\ h Mm 

Therefore, for every k ^ one gets 

^ Vn < £k- 

n>£i. 
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At last, for every /c ^ 0, set 

that is to say to — and — tk-i — ik for k ^ 1. Define, for k ^ 0, the interval 
of integers 

Jk — [tk, tk + £k — ^ — [tk, tk-i — 1] and Xji^ — Xti^.ti^_^_i. 
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f\/\ ^ times ^ times 

Figure 3: Splitting in intervals of times. 

Let Y = (Yi:)k^i be a sequence of random variables, independent of (X„, Un)n£i 
and such that for every k ^ 1, the law of is the law of Xi-ii^. 

For every k ^ 0, let us use the construction of section 3.2 set Xj^ = Yk, then for 
every 1^ + ik = h-i 

Xl = giUn,Pt,) where P^, = 

Therefore lemma 3.3| yields the inequality 

F[X,,..o^Xl, I Uj.eBy,] ^35fc, 

and 

P[Xo^ ^ Xo I f/j, G 5yJ ^ when k +00. 

Moreover each event {f/j^^ G -By^} is independent of the others (indeed they are 
functions of random variables Uk for disjoint sets of indices k) and 

+00 

J2^[Uj, G By,] =J2Pi. = Yl ^^P^- = 
since MmPi^ ^ 1 by choice of M^. 



Lemma 3.4, stated below, provides a deterministic increasing function 9 such that 



and J]P[f/j,(,) e5y,(,J =+00. 



Using Borel-Cantelli's lemma, one deduces that 
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• |Xq^^^ 7^ Xo}n{f/j^j^j G i?y^jj.j} is realized for a finite number of k only, a.s. 

• {f^je(fe) G -^ye(fe)} is realized for an infinite number of k a.s.. 
Thus, for every a E A, 

{Xo = a} = limsup {f/,,^,, G i?y,^,J H {x','^'^ = a}. 



Therefore, {Xq = a} belongs to Jq V cr{Y). Since the sequence Y = {Yk)k^Q is 



independent of J^q'^ , one gets 

P[Xo = a| J-Q^] = P[Xo = a I J-Q^ V = l{Xo=a} a.s., 

therefore {Xq = a} G By stationarity of the process {X,U), one gets the 
inclusion of the filtration J-""^ into the filtration J-"^. Therefore lemma [lT] yields 
that J-'-^ is immersed in J-"^, which ends the proof. □ 

Lemma 3.4 Let (a„)„^o one? {bn)n^o denote two bounded sequences of nonneg- 
ative real numbers such that the series &n diverges and such that an ^ 

n 

Then there exists an increasing function 9 : N ^ N such that the series a0(„) 

n 

converges and the series diverges. 

n 

4 Examples 

In this section we study some examples showing the advantages and the limita- 
tions of our results. 



Our first example (section 4.1) is a chain with memory of variable length 
which fulfills the hypotheses of theorem |3] but not those of theorem [T] nor 
theorem 121 Its natural filtration is standard. 



Our second example (section 4.2) is derived from the well known [T, T^^] 
transformation. It provides a stationary process with values in a finite 
space, whose natural filtration is not standard. This example does not 
fulfills any of the two conditions of theorem |3] (namely the priming condition 
and the summability of the gaps). 



Our third example (section 4.3) is a slight adaptation of the second one, 
where the filtration of the process is still non-standard although the priming 
condition is fulfilled. 



23 



Our fourth and last example (section 4.4) is another adaptation of the sec- 
ond example in which the filtration is standard although the condition of 
summability of the gaps is not fulfilled and the related conditional proba- 
bilities are close to those of the second example. 



4.1 First example : Parity of the number of 1 in a row 

This example provides a setting where one proves standardness using theorem [3] 
Let {Xn)nez be a stationary process taking values in {0, 1} such that 

P[Xo = I J'fj = ^ + is even or T=-oo} whcrC T := SUp{A; < : Xfc = 0}. 

The existence of such a process is ensured by proposition 2.10 in [3]. A simple 
computation gives, for every n ^ 0, 

1 1 1 1 ^2^ 

7n ^n= g, ttn = 7^, Vn < < -u] ^ 



Therefore this process fulfills the hypotheses of theorem p3] (and its corollary 1.2) 
but neither those of theorem [T] nor those of theorem [IT The filtration J-'^is 
standard. 



4.2 Second example : Random walk in random scenery 

The following is a process whose filtration is not standard. 

Let X = {Xn)n£Z and C = {Cs)s£Z be two independent sequences of i.i.d. random 
variables with uniform law on { — 1, 1}. Set 

Sn = Xi + ---+Xnifn^O 

Sn = -Xn+1 Xo if < ■ 

Therefore 5*^+1 = Sn + Xn+i for every n G Z. Set C^^ = F„. The stationary 
process Z defined by Z„, = (X„, Y„) for every n G Z and taking values in A = 
{—1,1}^ is called random walk in random scenery. 

This process is derived from the process ((X„+., Cs^+-))n&z where X„+. = {Xn+m)ms:o 
is the trajectory of X until time n and Cs„+- = {Cs„+s)sei, is the scenery seen 
from Sn- It is easy to prove that the processes Z and {Xn+.,Cs„+-)n£Z gener- 
ate the same filtration. Indeed, given {Xk,Csi,) for every k ^ n, one knows the 
trajectory X„+. and one can deduces the increments {Sn — Sk)k^n- Since those 
increments visit almost surely every integer, one can recover the scenery seen 
from Sn- 
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The process {{Xn+.,Cs„+-))n& is the most famous [T,T^^] process. Indeed the 
[T, T~^] transformation is the apphcation from { — 1, 1}^^ x { — 1, 1}^ into itself 
defined by 

One checks that for every n ^ 

{X^+.,Cs^^.) = [T,T-'r^X,C). 

According to [3], the natural filtration of the process {{Xn+.,Cs„+.))nez is not 
standard though its asymptotic a-field at — oo is trivial. Therefore the same 
holds for the natural filtration of Z. 

Let n ^ 0. Let us study the probabilities p{a\z) for a E A and z G A". Note 
z = {z_n, z_i), Zk = {xk, Vk) and a = {xq, yo). 

First, note that some of the events 

are impossible. Indeed, by definition of the process Y for i < j, Yi = Yj on the 
event Xj+i + ■ ■ ■ + Xj = 0. When the event {Z^n-.-i = z} is impossible, one says 
that z is not admissible. Note that to compute 7]^-, one only needs to consider 
probabilities p{-\z) and p{-\wz) for admissible z E A"- and w G A^. Yet, wz may 
be non-admissible even if z and w are admissible. 

Assume that z is admissible. Then P[Xo = Xo\Z_n:-i = z'j = 1/2. If for some 

i G {—n, —1}, Xj+i H hxo = 0, then the conditions Z_n:-i = z and Xq = Xq 

imply that Yq = yi. Otherwise, the color Yq is independent of and Xq. 

Thus for any admissible word z G A", 



p{a\z) 



1/2 if there exists i such that Xi+i + ■ ■ ■ + xq = and y^ = yi, 
if there exists i such that Xj+i + ■ ■ ■ + xq = and yo 7^ yi, 
1/4 otherwise. 



Therefore for every n ^ 0, 7„ = 1 and 5„ = a„ = 1/2. 

Furthermore, for almost every admissible word w = yn)n<o in A"^, there exists 
t < such that Xt+i + ■ ■ ■ + a;o = and the same argument gives that 

, , , 1 

P{a\w) = -l{y,=yo}- 

For non- admissible w G A^, the value of p{a\w) can be chosen arbitrarily. Set 
p{a\w) = l:l{ya=yo} where d = supjt ^ -1 : Xt+i H \- Xq = 0} 
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if d is well defined, and p{a\w) = 1/4 otherwise. 

With this convention, one gets that, for almost any admissible w G and 

z = y-n), ■ ■ ■ , (x^i, y-i)) e A''' 



\ n 

1 



\p{a\z) — p{a\wz)\ 



if there exists t G [— n, —1] such that + ■ ■ ■ + Xq = 
1/4 otherwise. 



Therefore, for every n ^ 0, 

r]n = ^(P[V^ G {-n,...,-l},X,+i + --- + X_i ^ 0] 

+ P[VzG {-n,...,-l},Xi+i + --- + X„i ^0]) 
= I P[VzG {-n,...,-l},X,+i + --- + X_i ^0]. 

One sees that rjn ~ C/y/n with C G M.'^. Hence the process Z does not fulfill any 
of the hypotheses of theorem [3] 



4.3 Third example : Random walk in random scenery 
with misreading 

We construct a variant of the random walk in random scenery which fulfills the 
priming condition but whose natural filtration is not standard. 



Construct Z„ = as in section 4.2 Fix q g]0, l/2[. Let {^n)nez be a 

sequence of i.i.d. random variables taking values in { — 1,1}, independent of J-"^ 
and such that P[^o = 1] = 1 ^ 9- Define a process (Z^)nez by 

The process (Z^)„gz is a random walk in random scenery in which at each time, 
one misreads the color of the site Yn with probability q. 

The processes Z' and ^n)nez generate the same filtration. Indeed, the random 
variables associated to the times m < n where Sm = Sn are independent and 
take the value 1 with probability 1 — g > 1/2, therefore the color Yn is the most 
common color among the colors l^m^m seen at those times. Therefore, for almost 
every z G A'^ and a G A, the corresponding conditional probability p\a\z) is 
equal to g/2 or to (1 — g)/2 depending on these colors. 

Moreover, by independent enlargement, J-"^ is immersed into J-"^'^ = J-"^'. Since 
J^^ is non-standard, one deduces that J-"^ is not standard either. 
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By a short calculation, one gets for every n > 0, 

q ^ l-2q 



In 



2q. 



— q 4 

Since the probabilities p'{a\z) related to this process satisfy p'{a\z) ^ g/2, for 
every a & A and z G A^, the priming condition is fulfilled. The exact value of 
p'{a\z) for 2 G A" is difficult to compute, but the corresponding gaps rj'^ verify 

in > (P[V^G{-/,...,-l},X,+i + ---+X_i^O] 

+ P[V^ G {-/, -1}, + ■ ■ ■ + X_i ^ 0] ) 
= (l-2g)r/„. 

Therefore for q < 1/2, the sequence {rj'^)n is not summable, thus the process Z' 
does not verify the condition of summability of the gaps. 



4.4 Fourth example : Random walk in renewed random 
scenery 

We construct another variant of the random walk in random scenery in which the 
natural filtration is standard although the condition of summability of the gaps 
of theorem [3] is not fulfilled. 

We consider a variant of the process (X„, Cs„+.)n& in which at each time n the 
color at of the scenery seen from Sn is changed with probability q g]0, l/2[. For 
every g G { — 1, 1}^, denote ^ G {— 1, 1}^ the application defined by 

g{s) = g{s) for s ^ and ^(0) = -g{Q). 

Let {XniGn) be a stationary Markov chain with values in { — 1,1} x {—1,1}^, 
with transition probabilities 



p[{x,g), {x\g')) 



;i-g)/2 iig' = g{x' + 



q/2 i{g' = g{x' + -) 

The random walk in renewed random scenery is the process Z" = {Z'^)n£z defined 
byZ;' = (X„,G„(0)). 

The corresponding probabilities p"{a\z) are close to the probabilities p{a\z). In- 
deed, 

(1 -g)/2 iip{a\z) = 1/2 



p"{a\z) 



q/2 iip{a\z) = 

1/4 iip{a\z) = 1/4: 
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Therefore the corresponding gaps verify 



To show that the filtration T^" is standard, one can use the following trick: 
instead of changing the color at of the scenery (?„ with probability q, one draws 
at random this color with probability 2q. One needs a random variable e„ taking 
the value 1 if this drawing occurs and otherwise, and a random variable Hn 
giving the color obtained if the drawing occurs. 

To construct these random variables, consider two independent sequences of ran- 
dom variables {pn)n& and {Ynju^z, independent of J^^'*^ such that 

• the are i.i.d. Bernoulli variables of parameter (1 — 2g)/(l — q), 

• the Vn are i.i.d. and uniform on {—1, 1}. 

Let, for every n e Z, 

£n = 1 - /5nl{G„(0)=G„-i(X„)} and Kn ^ GniO)l{e„=l} +Vnl{e„=0}- 

Let us show that the random variables f/„ = (X„,e„, constitute a governing 
sequence for the process Z". Given Z'^_^ and Un, one deduces Z'^ thanks to the 
equalities 

Gnis)^Gn-i{Xn + s) if£„ = Oors^O 

Gn{0) = Kn if Sn = 1. 

It remains to check that C/„ is independent of the cr— field Qn-i — J'n-i ^ 
fortiori of J^n-i ■ Thanks to the independence of the processes ^, V and (X, G) 
one gets for every x e { — 1, 1}, 

P[X„ = x; G'„ = G'„_i(X„ + -)|e^n-i] =(l-?)/2. 
Therefore, for every c and x in {—1, 1}, 

P[£n = 1 ; = C ; Xn = x\ Qn-l] = P[£n = 1 ; G'„(0) = C ; X„ = X | Gn-l] 

= (l) + (2) + (3), 

with 

(1) = P[/3„ = ; 7^ Gn-i{Xn + •) ; G'„_i(X„) = -c ; X„ = x | , 

(2) = P[/3„ = ; = G'„_i(X„ + ■) ; G„_i(X,) = c ; X„ = a; | 

(3) =P[^ = 1 ; Gny^Gn-l{Xr, + -) ; G'„_i(X„) = -c ; = x I 
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One gets 

(1) = ^xP[G„7^G„_i(X„ + -); Gn-i(x) = -c; X„ = a;|6;„_i] 
X F[Gn-i{x) = -c I Gn-l] 

X l{G„_i(x)=-c}, 





1 




X P 


1 




Q 




X 




q 


2 


1 


- Q 


Q 


X 




Q 


2 


1 


-Q 



q_ 

l-q q 



(2) = xP[G'„ = G'„_i(X„ + -) ; G'„_i(a;) = c; X„ = x I 

1 — g -' 



X X 



2 1 - g 

2 



P[G„_i(x) = c I 



X l{G„-i(x)=c}, 



and 



q 

2' 



(3) = ^^xP[G'„7^G„_i(X„ + -); G'„_i(a;) = -c; X„ = a;|a„_i] 
1 — g '- 

= |xi^xP[G'„_i(x) = -c|e;„_i] 
2 1 — g '- ^ 

q 1 - 2g ^ 

= 2 ^ 1 _g ^ 1{G„_1{X) = -C}. 

Thus, for every c and x in { — 1,1}, 

F[en = 1 ; K„ = c ; = x | ^„,_i] 

Moreover, by independence of and 

P[£:„ = ; K„ = c ; X„ = X I 

= P[/3, = 1 ; G„ = + .) ; K = c ; X„ = x|e;„_i] 

1 - 2g 1 1 - g 

= X - X 

1-g 2 2 

l-2g 
4 ■ 

This shows that the random variables = (X„, constitute a governing 

sequence for the process Z". 

Let us show the inclusion J-jf " C J-'^ for any n E that is to say, that the se- 
quence {Uk)k^n is sufficient to recover the scenery Gn seen from Sn- The variables 
{Xk)k^n determine the increments {Sn — Sk)k^n and for every s G Z, — Sk — s 
for an infinite number of times k ^ n. Among those times, there is an infinite 
number of times such that = 1. The value of at the last time k ^ n such 
that Sn — Sk = s and = 1 is equal to Gnjs). Th erefore J-"*^ C J-"^, and since 



J-'^ C J-'^ , one gets J-'^" C J-"^. Finally, lemma |l.l| yields that J-"^" is immersed 



in , therefore the natural filtration of the process (Z")„ga is standard. 
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5 Proofs of auxiliary facts 

5.1 Inequalities involving an,Sn,'yn and rjn 

To prove that 5„ ^ 7^ for every n ^ 0, consider x and y in A"^ and z G A^' 
Then, 



-p{-\yz)\\ = ^ [p(a|x^) -p(a|y^)]_^ 

aeA 

Taking the supremum over a;, y and 2;, one gets bn ^ 7n- 

To prove that r/„ ^ 5„ for every n ^ 0, consider for every z e A", the law 

Qz of -'^^^-i conditionally on X^n:-\ — Then, 

v{-\z) = / ip{-\yz)Qz{^y). 
Ja< 

Thus, for every x in and z m. A^, 

\\p{-\z) - p{-\xz)\\ = / [p{-\yz)-p{-\xz))Qz{dy) 

Jy&A< 



JyeA< 



^ sup ^ 

For every z in A", — || ^ 5„ almost surely. Taking the expec- 

tation and the average over z, one gets rjn ^ 5n. 



To prove that 5„ ^ an for every n ^ 0, consider 2; e ^4" and G A^. 
Then, 



aeA 

^ 1- inf^ Xi'^f • y^^^} 



aeA 



This ends the proof. 
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5.2 Proof of lemma 11.11 

Assume that X is a process valued in a measurable space {E, (£) and that U is 
a governing and generating process of X. Let n G Z. Since U governs X, there 
exists a measurable function ipn such that Xn+i = ipniUn+i, X^) (axiom (ii)). 
Let S G We try to estimate 

p = P[X„+i G B I = P[^„(f/„+i,X„^) G I 

Since U governs X, Un+i and J^^'^ independent (axiom (i)) hence p is a 
function of X^ only, that is, 

p = p[^(f/„+i,x„^) G 5 I :f^] = p[x„+i G i? I :f^]. 

Hence J-'^+i is independent of J-"^ conditionally on J^^ . This shows that J-""^ is 
immersed in J-^^ . 



5.3 Proof of corollary 1.2 



Assume that X is a chain with memory of variable length and Y be an indepen- 
dent copy of X. As p{-\XX_^Y_n:-i) = p(-|F_„,_i). on the event {iiY^^) ^ n}, 

|b(-|XVl>^-n:-l) -p(-|V'-n:-l)|| ^ l^y^ 

Taking expectations, one gets rjn ^ P[£(F5l) ^ n + 1], hence 

J2Vn^ni{Y^l)]<+00. 



This ends the proof. 



5.4 Proof that 7/(7) provides a positive lower bound for 

p{a\x) 

We show that 'H{'y) implies the existence of c > such that p{a\x) ^ c for every 
X in and a such that P[Xo = a] > 0. 
Assume that 'H(7), that is 

+00 k 
fc=0 n=0 
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Therefore, 1 — 70 > 0. By definition of 70, for every a e A, x,y e A"^, 

p{a\x) ^ (1 - 7o)p(a|2/)- 
Integrating this inequahty with respect to the law of X^, one gets 

p{a\x) ^ (l-7o)P[Xo = a]. 
Since A is finite, this ends the proof. 
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